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Non-Final Rejection 
Response to Amendment 

1 . It is hereby acknowledged that the following papers have been received and 
placed on record in the file: Amendment as received on 04-2-2005. 

2. Claims 1-18 have been examined. 
Status of Claims: 

3. Claims 1, 4, 8, 9, 12, and 16-18 are rejected under 35 U.S.C. 103(a) as being 
unpatentable over Yager et al., Patent #5,983,236, hereinafter Yager and Nagai et al., 
Patent #6,795,092, hereinafter Nagai. 

4. Claims 2 and 10 are rejected under 35 U.S.C. 103(a) as being unpatentable over 
Yager, Nagai, and Chernock et al., Patent #6,314,569, hereinafter Chernock. 

5. Claims 5-7 and 13-15 are rejected under 35 U.S.C. 103(a) as being unpatentable 
over Yager, Nagai, and Coelho et al., Patent #5,748,196, hereinafter Coelho. 

6. Claims 3 and 1 1 have been canceled. 

Claim Rejections - 35 USC § 103 

7. The following is a quotation of 35 U.S.C. 103(a) which forms the basis for all 
obviousness rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described as set 
forth in section 1 02 of this title, if the differences between the subject matter sought to be patented and 
the prior art are such that the subject matter as a whole would have been obvious at the time the 
invention was made to a person having ordinary skill in the art to which said subject matter pertains. 
Patentability shall not be negatived by the manner in which the invention was made. 

8. Claims 1, 4, 8, 9, 12, and 16-18 are rejected under 35 U.S.C. 103(a) as being 
unpatentable over Yager et al., Patent #5,983,236, hereinafter Yager and Nagai et al., 
Patent #6,795,092, hereinafter Nagai. 
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9. With regard to claim 1 , which teaches a multimedia system comprising: a file 
storage that stores a multimedia file, Yager teaches, in column 1 , line 1 and lines 45-61 , 
a multimedia system where video data files are stored on the clients computer. With 
regard to claim 1 , further teaching a plurality of sequence tracks including: a 
performance sequence track (which stores audio information), a drawing sequence 
track (which stores picture sequence information), and a synchronization means for 
synchronizing the two, Yager teaches, in column 2, lines 42-55, a video dip which 
contains video images, still images, audio signals, and text, also further including a 
synchronization information to correlate the various clip components. With regard to 
claim 1, further teaching the synchronization information containing control information 
effective to control a progression of each sequence track at a desired position along a 
time axis, Yager further teaches, in column 2, lines 42-55, the synchronization 
information containing synchronization data containing points of temporal correlation 
between various components. With regard to claim 1, further teaching a sequencer that 
processes the multimedia file for parallel running of the sequence tracks synchronously 
with each other according to the synchronization information, Yager teaches, in column. 
2, lines 46-65, a sequencing component that processes the multimedia video clip 
components to run together. With regard to claim 1 , further teaching a program storage 
that stores an application program which treats and controls the multimedia file, Yager 
teaches, in column 2, lines 34-37, a data storage unit for storing the audio and video 
data. With regard to claim 1 , further teaching an executing unit that executes the 
application program to enable the application program to communicate with the 
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sequencer for effecting a control of the parallel running of the sequence tracks, Yager 
teaches, in column 2, lines 34-65, a processor for executing the synchronous execution 
of the video and audio units. With regard to claim 1 , further teaching the sequence 
tracks including a start control and a stop control of the running of the sequence tracks, 
Yager teaches, in column 4, lines 11-14, play and pause controls for controlling the 
execution of the video clip. Yager, however, doesn't specifically teach the data 
structure constituted by a sequence of events and durations, where the durations 
indicate time intervals between successive events. Nagai teaches, in column 1 , lines 6- 
12 and column 2, liens 45-54, an apparatus, method, and storage medium for the 
temporal correlation of a plurality of types of media data, similar to that of Yager, but 
further teaches, in column 9, lines 45-65 and. in figure 5, organizing scenes of the same 
data structure on a time axis where events (symbolized by bold lines) are given 
durations (start and end times) provide them with reproduction timing. It would have 
been obvious to one of ordinary skill in the art, having the teachings of Yager and Nagai 
before him at the time the invention was made to modify the temporal organization of 
media data of Yager to include the duration and event structure of Nagai. One would 
have been motivated to make such a combination because this would provide Yager 
with an event organizational means for its segments providing defined start and end 
times as Nagai used for its' scenes. 

10. With regard to claims 4 and 12, which teach the synchronization information 
includes control information effective to control a progression of each sequence track 
along a time axis, Yager teaches, in column 2, lines 46-65, a single master 
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synchronization component or individual components, which control the temporal 
correlation between the various video clip components. Nagai further teaches, in 
column 1 , lines 6-12 and column 2, liens 45-54, a organization of scenes along a time 
axis. 

1 1 . With regard to claim 8, which teaches a multimedia system that includes a 
plurality of sequence tracks, Yager teaches, in column 1, line 1 and lines 45-61, a 
multimedia system where video data files are stored on the client's computer. With 
regard to claim 8, further teaching a performance sequence track (which stores audio 
information), a drawing sequence track (which stores picture sequence information), 
and a synchronization means for synchronizing the two, Yager teaches, in column 2, 
lines 42-55, a video clip which contains video images, still images, audio signals, and 
text, also further including a synchronization information to correlate the various clip 
components. With regard to claim 8, further teaching a sequencer that processes the 
multimedia file for parallel running of the sequence tracks synchronously with each 
other according to the synchronization information, Yager teaches, in column 2, lines 
46-65, a sequencing component that processes the multimedia video clip components 
to run together. With regard to claim 8, further teaching the synchronization information 
containing control information effective to control a progression of each sequence track 
at a desired position along a time axis, Yager further teaches, in column 2, lines 42-55, 
the synchronization information containing synchronization data containing points of 
temporal correlation between various components. With regard to claim 8, further 
teaching a program storage that stores an application program which treats and controls 
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the multimedia file, Yager teaches, in column 2, lines 34-37, a data storage unit for 
storing the audio and video data. With regard to claim 8, further teaching an executing 
unit that executes the application program to enable the application program to 
communicate with the sequencer for effecting a control of the parallel running of the 
sequence tracks, Yager teaches, in column 2, lines 34-65, a processor for executing the 
synchronous execution of the video and audio units. With regard to claim 8, further 
teaching the sequence tracks including a start control and a stop control of the running 
of the sequence tracks, Yager teaches, in column 4, lines 11-14, play and pause 
controls for controlling the execution of the video clip. Yager, however, doesn't 
specifically teach the data structure constituted by a sequence of events and durations, 
where the durations indicate time intervals between successive events. Nagai teaches, 
in column 1, lines 6-12 and column 2, liens 45-54, an apparatus, method, and storage 
medium for the temporal correlation of a plurality of types of media data, similar to that 
of Yager, but further teaches, in column 9, lines 45-65 and in figure 5, organizing 
scenes of the same data structure on a time axis where events (symbolized by bold 
lines) are given durations (start and end times) provide them with reproduction timing. It 
would have been obvious to one of ordinary skill in the art, having the teachings of 
Yager and Nagai before him at the time the invention was made to modify the temporal 
organization of media data of Yager to include the duration and event structure of 
Nagai. One would have been motivated to make such a combination because this 
would provide Yager with an event organizational means for its segments providing 
defined start and end times as Nagai used for its' scenes. 
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12. With regard to claim 9, which teaches a method of playing a multimedia file, 
comprising a plurality of tracks, by combination of a sequencer and an application 
program, Yager teaches, in column 2, lines 34-65, in column 4, lines 10-14, and in 
column 6, lines 10-17, playing a multimedia file through the use of an application 
program and a sequencing element. With regard to claim 9, which further teaches a 
multimedia system comprising: sequence tracks including: a performance sequence 
track (which stores audio information), a drawing sequence track (which stores picture 
sequence information), and a synchronization means for synchronizing the two, Yager 
teaches, in column 2, lines 42-55, a video clip which contains video images, still images, 
audio signals, and text, also further including a synchronization information to correlate 
the various clip components. With regard to claim 9, further teaching a sequencer that 
processes the multimedia file for parallel running of the sequence tracks synchronously 
with each other according to the synchronization information, Yager teaches, in column 
2, lines 46-65, a sequencing component that processes the multimedia video clip 
components to run together. With regard to claim 9, further teaching the 
synchronization information containing control information effective to control a 
progression of each sequence track at a desired position along, a time axis, Yager 
further teaches, in column 2, lines 42-55, the synchronization information containing 
synchronization data containing points of temporal correlation between various 
components. With regard to claim 9, further teaching a program storage that stores an 
application program which treats and controls the multimedia file, Yager teaches, in 
column 2, lines 34-37, a data storage unit for storing the audio and video data. With 
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regard to claim 9, further teaching the sequence tracks including a start control and a 
stop control of the running of the sequence tracks, Yager teaches, in column 4, lines 1 1 - 
14, play and pause controls for controlling the execution of the video clip. Yager, 
however, doesn't specifically teach the data structure constituted by a sequence of 
events and durations, where the durations indicate time intervals between successive 
events. Nagai teaches, in column 1, lines 6-12 and column 2, liens 45-54, an 
apparatus, method, and storage medium for the temporal correlation of a plurality of 
types of media data, similar to that of Yager, but further teaches, in column 9, lines 45- 
65 and in figure 5, organizing scenes of the same data structure on a time axis where 
events (symbolized by bold lines) are given durations (start and end times) provide 
them with reproduction timing. It would have been obvious to one of ordinary skill in the 
art, having the teachings of Yager and Nagai before him at the time the invention was 
made to modify the temporal organization of media data of Yager to include the duration 
and event structure of Nagai. One would have been motivated to make such a 
combination because this would provide Yager with an event organizational means for 
its segments providing defined start and end times as Nagai used for its' scenes. 
1 3. With regard to claims 16-1 8, which teach the executing unit effecting the control 
of the parallel running of the sequence tracks including at least one of a pausing control 
for pausing the running of sequence tracks, a branching control for branching the 
sequence tracks,, and a repetition control for repeating a part of the sequence tracks, 
Yager further teaches, in column 4, lines 9-18, a user control array providing the user 



Application/Control Number: 09/871 ,543 Page 9 

Art Unit: 2173 

with means to play, rewind (branch and possibly replay), pause, stop sequencing and 
further to select from a slider the location to commence the sequence. 

14. Claims 2 and 10 are rejected under 35 U.S.C. 103(a) as being unpatentable over 
Yager, Nagai, and Chernock et al., Patent #6,314,569, hereinafter Chernock. 

15. With regard to claims 2 and 10, Yager and Nagai teach, a multimedia system, 
comprising a video part and an audio part (see column 2, lines 42-55). Yager and 
Nagai, however, fails to teach that an audio part that contains different parts for music 
data and for audio data. Chernock teaches a video/audio presentation system similar to 
that of Yager and Nagai, but further teaches, in column 5, line 67 through column 6, line 
3, two separate tracks of audio, where there is one for music and a separate for 
dialogue. It would have been obvious to one of ordinary skill in the art, having the 
teachings of Yager, Nagai, and Chernock before him at the time the invention was 
made to modify the multimedia system of Yager and Nagai to include the two distinct 
audio portions as did Chernock. One would have been motivated to make such a 
combination because this would allow modification to one track while the other could 
continue to play. 

16. Claims 5-7 and 13-15 are rejected under 35 U.S.C. 103(a) as being unpatentable 
over Yager, Nagai, and Coelho et ah, Patent #5,748,196, hereinafter Coelho. 

17. With regard to claims 5 and 13, Yager and Nagai teach, a multimedia system that 
includes a drawing sequence track (see column 2, lines 42-55) and that textural 
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information (a display object or a sprite) is integrated into the video sequence (see 
column 1 , lines 58-61 ). Yager and Nagai, however, doesn't teach that the drawing 
sequence is constituted by a sequence of display events and durations, where a display 
event indicates a display object, which is drawn during the running of the drawing 
sequence track, the duration indicating a time interval between a pair of successive 
display events. Coelho teaches a audio/video sequence processing system similar to 
that of Yager and Nagai, but further teaches, in column 2, lines 47-50, in column 5, line 
62 through column 6, line 48, and column 12, lines 7-13, a movable object (sprite) which 
is overlaid on a fixed or relatively slow moving background, in which the graphics object 
(sprite) is sequenced in time. It would have been obvious to one of ordinary skill in the 
art, having the teachings of Yager, Nagai, and Coelho before him at the time the 
invention was made to modify the multimedia system of Yager and Nagai to have the 
display event containing display objects as did Coelho. One would have been 
motivated to make such a combination because overlaying graphics images allows for 
modification of one without modifying the whole display. 

18. With regard to claims 6 and 14, which teach that the display event includes 
layout information effective to specify a position of the display object relative to a display 
screen in a plurality of coordinate formats according to a size of the display screen and 
a size of the display object. Coelho further teaches, in column 2, lines 47-50 and in 
column 5, line 62 through column 6, line 48, a movable object (sprite) which is overlaid 
on a fixed or relatively slow moving background, in which the graphics object (sprite) 
layout information including a specific object size and position (see column 6, lines 19- 
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22) and the surface in which the object is laid upon contains it's own width and height 
(in pixels) (see column 6, lines 5-9). 

1 9. With regard to claims 7 and 1 5, which teach a display event comprising a primary 
block containing definition information effective to define the display object, and a 
secondary block containing modification information effective to impart movements to 
the display object, the modification information being selected to impart one or more of 
different movements which are independent from one another and which do not 
interfere with one another, Coelho further teaches, in column 2, lines 47-59 and in 
column 6, lines 15-44, groups of object characteristics that contain location and size 
characteristics, and groups of object characteristics that contain object sequence 
movement data. 

Response to Arguments 

20. The arguments filed on 4-22-2004 have been fully considered but they are not 
persuasive. Reasons set forth below. 

21 . The applicants' argue that Yager does not contain any disclosure or suggestion 
of a multimedia file comprising a plurality of sequence tracks, all of which use the same 
data structure constituting successive sequence events and durations indicating the 
time intervals between the events. 

22. Applicant's arguments with respect to claims 1 , 8, and 9, have been considered 
but are moot in view of the new ground(s) of rejection. 



Application/Control Number: 09/871,543 Page 12 

Art Unit: 2173 

23. The applicants' further argue that there is no teaching of synchronization 
information including control information that controls the progression of plural 
sequence tracks. 

24. In response, the examiner respectfully submits that Yager teaches, in column 2, 
lines 42-55, the synchronization information containing synchronization data containing 
points of temporal correlation between various components. Nagai further teaches this 
control information in column 2, lines 45-54, teaching reproduction conttol infromaiton 
defining time relationships between media data, which is shown to be of different types. 

Conclusion 

25. Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to Dennis G. Bonshock whose telephone number is (571 ) 
272-4047. The examiner can normally be reached on Monday - Friday, 6:30 a.m. - 4:00 
p.m. 

26. If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, John Cabeca can be reached on (571) 272-4048. The fax phone number 
for the organization where this application or proceeding is assigned is 703-872-9306. 
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27. Information regarding the status of an application may be obtained from the 
Patent Application Information Retrieval (PAIR) system. Status information for 
published applications may be obtained from either Private PAIR or Public PAIR. 
Status information for unpublished applications is available through Private PAIR only. 
For more information about the PAIR system, see http://pair-direct.uspto.gov. Should 
you have questions on access to the Private PAIR system, contact the Electronic 
Business Center (EBC) at 866-21 7-91 97 (toll-free). 
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